Display control system and recording medium for displaying a guide image

ABSTRACT

There is provided a display control system including a plurality of display units, an imaging unit configured to capture a subject, a predictor configured to predict an action of the subject according to a captured image captured by the imaging unit, a guide image generator configured to generate a guide image that guides the subject according to a prediction result from the predictor, and a display controller configured to, on the basis of the prediction result from the predictor, select a display unit capable of displaying an image at a position corresponding to the subject from the plurality of display units, and to control the selected display unit to display the guide image at the position corresponding to the subject.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 14/103,032, filed on Dec. 11, 2013, which claims the benefit ofJapanese Priority Patent Application JP 2012-279520 filed Dec. 21, 2012,the disclosures of which are incorporated herein by reference.

BACKGROUND

The present disclosure relates to a display control system and arecording medium.

Within facilities such as amusement centers, train stations, hospitals,and municipal offices, map boards, guidance displays that indicate theroute to a goal, and the like are provided throughout. However, withfacilities of larger scale, the guide display becomes complicated, andmay inconvenience users, such as by imposing the burden of checkingone's current location or route many times until one reaches a goal. Forthis reason, technology that provides a suitable, personalized guidedisplay to individuals is being developed.

For example, Japanese Unexamined Patent Application Publication No.2004-110377 discloses technology in an airport facility that specifies acustomer by an identification tag possessed by the customer, andprovides a guide display based on pre-acquired customer information orinformation related to a departing flight near that specified customer'sposition.

Also, Japanese Unexamined Patent Application Publication No. 2000-149150discloses technology in a hospital that specifies a patient by anidentification card possessed by the patient, a voiceprint, afingerprint, the iris, or the like, and provides the specified patientwith a guidance display to a destination input in advance by receptionstaff or a doctor in the examining room.

SUMMARY

However, the above technologies disclosed in Japanese Unexamined PatentApplication Publication No. 2004-110377 and Japanese Unexamined PatentApplication Publication No. 2000-149150 both provide a guide/guidancedisplay to a subject on the basis of information that has been input andstored in advance, and do not provide an interactive display dependingon the subject's current state.

Accordingly, the present disclosure proposes a new and improved displaycontrol system and recording medium able to predict a subject's actions,and provide a guide display according to the prediction result.

According to an embodiment of the present disclosure, there is provideda display control system including a plurality of display units, animaging unit configured to capture a subject, a predictor configured topredict an action of the subject according to a captured image capturedby the imaging unit, a guide image generator configured to generate aguide image that guides the subject according to a prediction resultfrom the predictor, and a display controller configured to, on the basisof the prediction result from the predictor, select a display unitcapable of displaying an image at a position corresponding to thesubject from the plurality of display units, and to control the selecteddisplay unit to display the guide image at the position corresponding tothe subject.

According to an embodiment of the present disclosure, there is provideda non-transitory computer-readable recording medium having a programrecorded thereon, the program causing a computer to execute capturing asubject, predicting an action of the subject according to a capturedimage, selecting, from a plurality of display units on the basis of aprediction result, a display unit capable of displaying an image at aposition corresponding to the subject, generating a guide image thatguides the subject according to the prediction result, and controllingthe selected display unit to display the guide image at the positioncorresponding to the subject.

According to an embodiment of the present disclosure as described above,it is possible to predict a subject's actions, and provide a guidedisplay according to the prediction result.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an explanatory diagram illustrating an overview of a displaycontrol system according to an embodiment of the present disclosure;

FIG. 2 is a block diagram illustrating a configuration of a displaycontrol system according to the first embodiment;

FIG. 3 is a flowchart illustrating operations of a display controlsystem according to the first embodiment;

FIG. 4 is an explanatory diagram illustrating an applied example of adisplay control system according to the first embodiment;

FIG. 5 is an explanatory diagram explaining an example in which adisplay control system according to the first embodiment updates a guideimage according to a subject's reaction;

FIG. 6 is an explanatory diagram explaining an example in which adisplay control system according to the first embodiment updates a guideimage according to a subject's reaction;

FIG. 7 is an explanatory diagram explaining an example in which adisplay control system according to the first embodiment updates a guideimage according to a subject's reaction;

FIG. 8 is an explanatory diagram for explaining operations of a displaycontrol system according to Modification 1;

FIG. 9 is an explanatory diagram for explaining operations of a displaycontrol system according to Modification 2;

FIG. 10 is a flowchart illustrating operations of a display controlsystem according to Modification 3;

FIG. 11 is a flowchart illustrating operations of a display controlsystem according to the second embodiment;

FIG. 12 is an explanatory diagram illustrating an applied example of adisplay control system according to the second embodiment;

FIG. 13 is an explanatory diagram illustrating an applied example of adisplay control system according to the second embodiment; and

FIG. 14 is an explanatory diagram illustrating an applied example of adisplay control system according to the second embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENT(S)

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in this specification and the appended drawings, structural elementsthat have substantially the same function and structure are denoted withthe same reference numerals, and repeated explanation of thesestructural elements is omitted.

Hereinafter, the description will proceed in the following order.

1. Overview of display control system

2. Embodiments

-   -   2-1. First embodiment        -   2-1-1. Configuration        -   2-1-2. Operational process        -   2-1-3. Modification 1        -   2-1-4. Modification 2        -   2-1-5. Modification 3    -   2-2. Second embodiment        -   2-2-1. Operational process        -   2-2-2. Applied Example 1        -   2-2-3. Applied Example 2        -   2-2-4. Other applied examples

3. Conclusion

1. OVERVIEW OF DISPLAY CONTROL SYSTEM

The present disclosure may be carried out in various embodiments,examples of which are described in detail from sections (2-1. Firstembodiment) to (2-2. Second embodiment). Also, a display control systemaccording to each embodiment is equipped with:

A. multiple display units (display devices 2);

B. an imaging unit (camera 1) that captures a subject;

C. a predictor (predictor 42) that predicts an action of the subjectaccording to a captured image captured by the imaging unit;

D. a guide image generator (guide image generator 43) that generates aguide image that guides the subject according to a prediction resultfrom the predictor; and

E. a display controller (display controller 44) that, on the basis of aprediction result from the predictor, selects a display unit able todisplay an image at a position corresponding to the subject from amongthe multiple display units, and controls the selected display unit todisplay the guide image at a position corresponding to the subject.

As described below, a display control system according to an embodimentof the present disclosure predicts a future action on the basis of asubject's current state, and displays a guide image generated accordingto the prediction result on a display unit selected from among multipledisplay units according to the prediction result.

Specifically, first, a predictor predicts a subject's future actionaccording to a captured image captured by an imaging unit. For example,the predictor predicts a future action by estimating factors such as asubject's goal, something the subject is searching for, or the fact thatan activity was aborted partway through, according to a captured imagecapturing factors such as the direction in which the subject is facing,a path selection at a corner or turn, a walking speed, a gesture, orline of sight movement.

Next, the guide image generator generates a guide image that guides thesubject according to the prediction result from the predictor. Forexample, the guide image generator generates a guide image indicating aroute to a goal, the position of something the subject is searching for,information reminding the subject of the aborted activity, or the like.In this way, a display control system according to an embodiment of thepresent disclosure is able to generate an interactive guide imagedepending on the subject's current state.

Subsequently, the display controller selects a display unit able todisplay an image at a position corresponding to the subject from amongthe multiple display units on the basis of the prediction result fromthe predictor, and controls the selected display unit to display a guideimage at the position corresponding to the subject. For example, thedisplay controller selects a display unit which is placed in thedirection in which the subject is facing and which is capable ofdisplaying an image near the subject's position, and controls theselected display unit to display a guide image at a position dependingon the orientation of the subject's face or the height of the subject'spoint of view. In this way, a display control system according to anembodiment of the present disclosure is able to display a guide image ata suitable position depending on the subject's current state, or inother words, at a position easily visible to the subject.

Note that the above display unit and imaging unit may be installedindoors, such as in a room, house, or building, and also may beinstalled outdoors, such as by a street, on the wall of a building, oron a streetlight.

Guide image display operations by a display control system according toan embodiment of the present disclosure as described above will now bespecifically described with reference to FIG. 1. As an example, FIG. 1illustrates an example of applying a display control system according toan embodiment of the present disclosure to a hospital.

FIG. 1 is an explanatory diagram illustrating an overview of a displaycontrol system according to an embodiment of the present disclosure. Asillustrated in FIG. 1, cameras 1A, 1B, and 1C as well as display devices2A, 2B, and 2C are installed along a corridor inside a hospital. Notethat hereinafter, the cameras 1A, 1B, and 1C will be collectivelydesignated the cameras 1 when not being particularly distinguished.Similarly, the display devices 2A, 2B, and 2C will be collectivelydesignated the display devices 2 when not being particularlydistinguished. Also, as illustrated in FIG. 1, the display devices 2 arerealized by projectors, for example.

Also, the cameras 1 and the display devices 2 are connected to a server(not illustrated) via a network, with the server including thepredictor, guide image generator, and display controller describedabove. Alternatively, the predictor, guide image generator, and displaycontroller described above may also be included in at least one of thecameras 1 and the display devices 2.

Herein, in the corridor illustrated in FIG. 1, the camera 1A captures asubject walking in the X direction. Subsequently, in the case where thesubject continues walking and approaches an intersection, the predictorpredicts, on the basis of the captured image, that the subject will takean action of either advancing straight in the X direction, or turning tothe Y direction. Next, on the basis of a prediction result indicatingthat the subject will continue walking, the display controller selects,from among the multiple display devices 2A to 2C, the display device 2Bcapable of displaying an image on a display surface 3 which is in theadvancing direction of the subject and which is at a distance visible tothe subject. Also, according to the prediction result indicating thatthe subject may take an action of either advancing straight in the Xdirection or turning to the Y direction, the guide image generatorgenerates a guide image that includes a display of an arrow in the Xdirection and an examining room positioned in the X direction, as wellas a display of an arrow in the Y direction and a restroom positioned inthe Y direction. Then, as illustrated in FIG. 1, the display controllercontrols the display device 2B to display a guide image 9 on the displaysurface 3 at the intersection, which is taken to be a position easilyvisible to the subject.

In this way, a display control system according to an embodiment of thepresent disclosure is able to predict a subject's actions, and provide aguide display according to the prediction result.

The above thus summarizes a display control system according to anembodiment of the present disclosure. Next, a display control systemaccording to an embodiment of the present disclosure will bespecifically described using several embodiments.

2. EMBODIMENTS 2-1. First Embodiment 2-1-1. Configuration

First, a configuration of a display control system according to thefirst embodiment will be described with reference to FIG. 2. FIG. 2 is ablock diagram illustrating a configuration of a display control systemaccording to the first embodiment. As illustrated in FIG. 2, the displaycontrol system includes cameras 1A to 1C, display devices 2A to 2C, anda server 4. Note that although a single camera 1 may be included in thedisplay control system, this specification describes the case ofincluding multiple cameras 1 as an example. Hereinafter, each structuralelement of the display control system will be described in detail.

(Camera 1)

A camera 1 includes an image sensor, imaging optics that include animaging lens, and a captured image signal processor. The camera 1outputs data of a captured image in the form of a digital signal. Notethat the image sensor is realized by a charge-coupled device (CCD)imager or a complementary metal-oxide-semiconductor (CMOS) imager, forexample. Also, a camera 1 according to the present embodiment captures asubject, and transmits a captured image to the server 4. Note that acamera 1 may also be calibrated in order to estimate device-specificcharacteristics prior to being installed. Otherwise, an automaticcalibration setup used by the manufacturer or the like may also beutilized. Also, a camera 1 may be integrally formed with a displaydevice 2 described next.

(Display Device 2)

A display device 2 displays image data (still image/moving image) on thebasis of control by the server 4. The display device 2 is realized by aprojector as illustrated in FIG. 1, for example. Otherwise, a displaydevice 2 may be realized by a liquid crystal display (LCD), organiclight-emitting diode (OLED) display, or the like, for example. Also, adisplay device 2 according to the present embodiment displays a guideimage generated by a guide image generator 43 discussed later. Note thata display device 2 may also be calibrated in order to estimatedevice-specific characteristics prior to being installed.

(Server 4)

The server 4 predicts a subject's future actions on the basis of acaptured image captured by a camera 1, and causes a display device 2 todisplay a guide image generated according to the prediction result.Also, as illustrated in FIG. 2, the server 4 functions as an actionhistory information acquirer 41, a predictor 42, a guide image generator43, a display controller 44, and a learning unit 45.

Action History Information Acquirer 41

The action history information acquirer 41 acquires action historyinformation for a subject on the basis of a captured image captured by acamera 1. Action history information refers to information indicatinghow a subject has acted at what positions, both currently and in thepast. A subject's actions indicated by action history information maybe, for example, walking or stopping, respective gestures such asraising one's hand, the selection of a path at a corridor intersection,and the like. The action history information acquirer 41 acquiresinformation indicating how a subject acted on the basis of a capturedimage, and also references memory discussed later to acquire positioninformation indicating the position and height of the camera 1 thatcaptured that captured image, and thereby also acquires informationindicating the position at which that action was taken.

At this point, the action history information acquirer 41 may alsosupplement information indicating past actions with informationindicating a current action. For example, the action history informationacquirer 41 may also acquire, as action history information, informationindicating a subject's action obtained from a current captured imagethat has been added to information indicating a subject's actions thatthe action history information acquirer 41 itself obtained in the past.Otherwise, the action history information acquirer 41 may also acquire,as action history information, information indicating a subject's actionobtained from a current captured image that has been added toinformation indicating a subject's actions received externally via anetwork or the like.

Also, the action history information acquirer 41 is capable ofidentifying a subject by applying facial recognition to a face depictedin a captured image, and accumulating information indicating a currentaction, which is added to action history information acquired in thepast for the same person. Besides a facial recognition process, theidentification of a subject may also be conducted with an identificationdevice such as a radio-frequency identification (RFID) tag carried bythe subject.

In addition, the action history information acquirer 41 may alsoacquire, as one type of action history information, a subject's reactionto a guide image displayed by a display device 2. Specifically, theaction history information acquirer 41 may recognize a subject'sreaction to a guide image displayed by a display device 2 on the basisof a captured image captured by a camera 1, and acquire action historyinformation on the basis of the recognized reaction.

The action history information acquirer 41 outputs acquired actionhistory information to the predictor 42 and the learning unit 45.

Predictor 42

The predictor 42 predicts a subject's actions according to a capturedimage captured by a camera 1. More specifically, the predictor 42predicts a subject's actions on the basis of action history informationacquired from captured images by the action history information acquirer41. Otherwise, the predictor 42 may also predict a subject's actions onthe basis of an action pattern that the learning unit 45 discussed laterlearns from action history information acquired from captured images bythe action history information acquirer 41. The predictor 42 outputs aprediction result to the guide image generator 43 and the displaycontroller 44.

Guide Image Generator 43

The guide image generator 43 generates a guide image that guides thesubject according to a prediction result from the predictor 42.Specifically, the guide image generator 43 generates a guide image thatincludes a guide display to a subject's goal indicated by a predictionresult from the predictor 42. For example, the guide image generator 43generates a guide image indicating the respective destinations ofintersecting corridors, on the basis of a prediction result indicatingthat a subject will approach a corridor intersection. Otherwise, theguide image generator 43 generates a guide image that includes a displaysuggesting actions to a subject according to a prediction result basedon an action pattern from the predictor 42. The guide image generator 43may also generate a guide image according to physical characteristicssuch as a subject's height, sex, or race. The guide image generator 43outputs a generated guide image to the display controller 44.

Display Controller 44

The display controller 44 first selects a display device 2 able todisplay an image at a position corresponding to a subject from amongmultiple display devices 2, on the basis of a prediction result from thepredictor 42. For example, the display controller 44 selects a displaydevice 2 able to display an image on the floor surface of predictedwalking route, on the basis of a prediction result that a subject willcontinue walking. Otherwise, the display controller 44 selects a displaydevice 2 able to display an image on the wall surface at the end of acorridor, on the basis of a prediction result that a subject willcontinue walking and approach the end of a corridor. At this point, thedisplay controller 44 may also select a display device 2 able to displayan image near a subject's position, such as at the subject's feet or ona wall surface in front of the subject, on the basis of a predictionresult that the subject will stop walking and stand still. Furthermore,the display controller 44 may also select a display device 2 able todisplay an image in the direction faced by a subject, on the basis of aprediction result indicating the direction in which the subject isfacing. Note that in the case of selecting a display device 2, thedisplay controller 44 may select a display device 2 able to display animage at a position corresponding to a subject by referencing positioninformation indicating the respective installed positions and heights ofmultiple display devices 2, which is stored in memory discussed later.

Subsequently, the display controller 44 controls the selected displaydevice 2 to display a guide image output from the guide image generator43 at a position corresponding to a subject. At this point, the displaycontroller 44 may also control the selected display device 2 to displaya guide image at a position distanced in proportion to the subject'swalking speed. Generally, the faster a person's walking speed, thefarther he or she looks ahead, and thus the display controller 44 maycontrol a display device 2 to display a guide image at a positionfarther away from the subject to the extent that the subject's walkingspeed is fast, for example. Conversely, the display controller 44 mayalso control a display device 2 to display a guide image at a positioncloser to a subject to the extent that the subject's walking speed isslow. Otherwise, the display controller 44 may also control a displaydevice 2 to display a guide image according to physical characteristicssuch as a subject's height, sex, or race.

Learning Unit 45

The learning unit 45 learns a subject's action pattern on the basis ofaction history information output from the action history informationacquirer 41. The learning unit 45 then outputs a learned action patternto the predictor 42.

For example, assume that the action history information acquirer 41acquires, as action history information, a subject with a worried lookwho is holding a laptop PC in a conference room with a projector, andwho finds a cable for connecting the projector and the laptop PC severalminutes later. In this case, the learning unit 45 learns an actionpattern of “searching for a cable” in the case where a subject isholding a laptop PC in a conference room and has a worried look. As aresult, if a camera 1 captures a captured image in which a subject isholding a laptop PC in a conference room and has a worried look, thepredictor 42 predicts, on the basis of the learned action pattern, thatthe subject is searching for a projector cable.

Note that the predictor 42 may also predict a subject's actions on thebasis of another person's action pattern in the case where anotherperson's previously learned action pattern similarly applies to thesubject.

(Supplemental Remarks)

The server 4 may also include memory (not illustrated). As discussedabove, the memory stores position information indicating the respectiveinstalled positions and heights of multiple cameras 1 and multipledisplay devices 2. The memory also stores map information indicatingpositional relationships among streets, buildings, addresses, and thelike, as well as positional relationships among corridors, rooms, andthe like inside respective facilities, which is used in order for theguide image generator 43 to generate a guide image that includes a guidedisplay to a goal.

The above thus describes a configuration of a display control systemaccording to the present embodiment.

2-1-2. Operational Process

Next, operations of a display control system will be described withreference to FIGS. 3 to 7. FIG. 3 is a flowchart illustrating operationsof a display control system according to the first embodiment. FIG. 4 isan explanatory diagram illustrating an applied example of a displaycontrol system according to the first embodiment. Hereinafter,operations of the display control system in the applied exampleillustrated in FIG. 4 will be specifically described, following theflowchart illustrated in FIG. 3.

As illustrated in FIG. 4, cameras 1A and 1B as well as display devices2A, 2B, and 2C connected to a server 4 are placed along a corridorending in the X direction at a T intersection, and a subject 5 iswalking in the X direction. At this point, as illustrated in FIG. 3,first, in steps S104A and S104B the camera 1A and the camera 1B capturethe subject 5 walking in the X direction.

Next, in step S108, the camera 1A and the camera 1B transmit capturedimages capturing the subject 5 to the server 4.

Subsequently, in step S112, the action history information acquirer 41acquires action history information from the captured images receivedfrom the camera 1A and the camera 1B. More specifically, the actionhistory information acquirer 41 acquires the state of the subject 5walking in the X direction as action history information.

Subsequently, in step S116, the predictor 42 predicts the actions of thesubject 5 on the basis of the action history information acquired by theaction history information acquirer 41. More specifically, on the basisof the action history information indicating that the subject 5 iswalking in the X direction, the predictor 42 predicts that the subject 5will continue to walk in the X direction, and reach the T intersectionwith the corridor in the Y direction illustrated in FIG. 4.

Next, in step S120, on the basis of a prediction result from thepredictor 42, the display controller 44 selects the display device 2A,which is able to display an image at a position corresponding to thesubject 5. More specifically, on the basis of a prediction resultindicating that the subject 5 will continue to walk in the X direction,the display controller 44 selects the display device 2A, which is ableto display an image near the position of the subject 5, and also in theX direction in which the subject 5 is facing. For this reason, thedisplay control system is able to display a guide image at a positioneasily visible to the subject 5. For example, although a comparativeexample that provides guide displays in every direction surrounding thesubject 5 is conceivable, according to a display control system inaccordance with the present embodiment, a subject is able to see adesired guide display without looking all around.

Subsequently, in step S124, on the basis of a prediction result from thepredictor 42, the guide image generator 43 generates a goal selectionimage (guide image) that includes a guide display to a goal of thesubject 5. More specifically, on the basis of a prediction resultindicating that the subject 5 will reach the T intersection, the guideimage generator 43 generates a goal selection image that presents therespective destinations in the case of turning right or turning left atthe T intersection, and causes the subject 5 to select a goal.

Next, in step S128, the display controller 44 transmits the goalselection image generated by the guide image generator 43 to theselected display device 2A.

Then, in step S132, the display device 2A, under control by the displaycontroller 44, displays the received goal selection image 9-1 on adisplay surface 3A.

Subsequently, in steps S136A and S136B, the camera 1A and the camera 1Bcapture the selecting action (reaction) of the subject 5 with respect tothe goal selection image 9-1 displayed on the display surface 3A. Atthis point, assume that the subject 5 selects a goal reached by turningright at the T intersection. Note that the selecting action of thesubject 5 at this point, as well as the goal guide image displayed insteps S164A and S164C below, will be later described in detail.

Next, in step S140, the camera 1A and the camera 1B transmit capturedimages capturing the subject 5 to the server 4.

Subsequently, in step S144, the action history information acquirer 41acquires action history information from the captured images receivedfrom the camera 1A and the camera 1B. More specifically, the actionhistory information acquirer 41 acquires, as action history information,the state of selecting a goal A reached by turning right at the Tintersection, which is added to the information indicating that thesubject 5 was previously (S104A, S104B) walking in the X direction.

Subsequently, in step S148, the predictor 42 predicts the actions of thesubject 5 on the basis of the action history information acquired by theaction history information acquirer 41. More specifically, on the basisof action history information indicating that the subject 5 selected agoal reached by turning right at the T intersection, the predictor 42predicts that the subject 5 will continue walking and turn right at theT intersection.

Next, in step S152, on the basis of a prediction result from thepredictor 42, the display controller 44 selects the display devices 2Band 2C, which are able to display images at positions corresponding tothe subject 5. More specifically, on the basis of a prediction resultindicating that the subject 5 will continue to walk in the X direction,the display controller 44 selects the display devices 2B and 2C, whichare able to display images at positions visible to the subject 5 who hasmoved as a result of walking. In this way, the display control system isable to track the walking behavior of the subject 5 and switch thedisplay devices 2 that display guide images.

Subsequently, in step S156, on the basis of a prediction result from thepredictor 42, the guide image generator 43 generates a goal guide image(guide image) that includes a guide display to a goal of the subject 5.More specifically, on the basis of a prediction result indicating thatthe subject 5 will turn right at the T intersection, the guide imagegenerator 43 generates goal guide images that include a display withinstructions to turn right as well as a display of the goal A reached byturning right.

Next, in step S160, the display controller 44 transmits the goal guideimages generated by the guide image generator 43 to the selected displaydevices 2B and 2C.

Then, in step S164B, the display device 2B displays a received goalguide image 9-2 on a display surface 3B. Also, in step S164C, thedisplay device 2C displays a received goal guide image 9-3 on a displaysurface 3C.

In this way, a display control system is able display a goal guide imageon not only a display surface 3B on a floor, but also on a displaysurface 3C on a wall. For this reason, the subject 5 is able to notice agoal guide image and receive guidance to a goal A, irrespective ofwhether he or she is looking at the floor or looking ahead.

As described above, the display control system varies the goal guideimage to display in step S164, on the basis of a selecting action of thesubject 5 with respect to the goal selection image displayed in stepS132. As an example, changes in guide images based on selecting actionsof the subject 5 according to such a display control system will bedescribed in detail with reference to FIGS. 5 to 7.

FIGS. 5 to 7 are explanatory diagrams explaining an example in which adisplay control system according to the first embodiment updates a guideimage according to a subject's reaction.

As illustrated in FIG. 5, there is displayed on the display surface 3Ain front of the subject 5 a goal selection image 9-11 that includes adisplay of a right-turn arrow together with a goal A reached by turningright, as well as a display of a left-turn arrow together with a goal Breached by turning left. At this point, as a selecting action, thesubject 5 steps on either the right-turn arrow or the left-turn arrow.For example, if the subject 5 steps on the right-turn arrow, the displayon the display surface 3A switches from the goal selection image 9-11 toa goal guide image 9-12, and guide information to the goal A isdisplayed. In this way, the display control system is able to cause aguide image that includes only information corresponding to the subject5 to be displayed according to a selecting action of the subject 5,while hiding an irrelevant display. For this reason, the subject 5 isable to receive personalized guidance, and not receive complicatedguidance such as a listing of various routes to various goals.

As another example, as illustrated in FIG. 6, there is displayed on thedisplay surface 3A in front of the subject 5 a goal selection image 9-21that includes a display of a right-turn arrow together with a goal A anda goal C reached by turning right, as well as a display of a left-turnarrow together with a goal B reached by turning left. If the subject 5steps on the right-turn arrow as a selecting action, the display on thedisplay surface 3A switches from the goal selection image 9-21 toanother goal selection image 9-22. The goal selection image 9-22includes a display of a short right-turn arrow together with goal A thatis a short distance away after turning right, as well as a display of along right-turn arrow together with a goal B that is a long distanceaway after turning right. At this point, if the subject 5 steps on thelong right-turn arrow, the display on the display surface 3A switchesfrom the goal selection image 9-22 to a goal guide image 9-23, and guideinformation to the goal C is displayed. In this way, the display controlsystem is able to gradually narrow down the goal of the subject 5.

As another example, as illustrated in FIG. 7, the display control systemis able to provide a warning display to a subject 5 who is proceedingalong a wrong route. For example, in the case where the subject 5selected a goal D but then proceeded in the opposite direction, thedisplay control system generates a warning image 9-31 to be displayed onthe display surface 3C by the display device 2C, as illustrated in FIG.7. At this point, in order to emphasize the display, the guide imagegenerator 43 may set the font of the warning display to bold, a redcolor, or the like, and the display controller 44 may also cause thewarning image 9-31 to flash. Furthermore, the server 4 may also controla network-connected speaker 6A and speaker 6B to emit a warning sound.

(Supplemental Remarks)

Besides the above, the method by which a subject 5 selects a goal mayinclude gestures, spoken instructions, informing a receptionist, or thelike. The subject 5 makes a gesture or gives spoken instructions as theselecting action with respect to a displayed goal selection image. Also,in the case where the subject 5 informs a receptionist of a goal, thereceptionist inputs the goal of the subject 5 into the display controlsystem, by which the display control system displays a goal guide imageaccording to the goal of the subject 5.

Also, in the case where the subject 5 proceeds along a wrong path,although a warning image is displayed and guidance is provided to turnback in the example discussed above, the guide image generator 43 mayalso newly generate a guide image to the goal, and the displaycontroller 44 may update the display with the newly generated guideimage.

Also, in the case of selecting a wrong goal, the subject 5 may cancelhis or her own selection with a gesture such as shaking one's head orhand, or by giving spoken instructions, and cause the display controlsystem to once again display a goal selection image. At this point, onthe basis of a captured image depicting the cancel instructions from thesubject 5, the predictor 42 predicts that the subject 5 will re-select agoal, and the display controller 44 causes a goal selection image newlygenerated by the guide image generator 43 to be displayed. Also, themethod by which the subject 5 cancels his or her own selection andcauses a goal selection image to be displayed once again may involve abehavior of disengaging from the guiding indicated by a goal guideimage. For example, with the goal guide image 9-12 illustrated in FIG.5, provided that proceeding straight ahead while stepping on the arrowsindicates that the goal is correct, the subject 5 may also cause thedisplay control system to once again display a goal selection image byproceeding without stepping on the arrows.

The above thus describes an operational process of a display controlsystem according to the first embodiment.

2-1-3. Modification 1

Next, a modification of the first embodiment will be described. Adisplay control system according to the present modification generatesand displays a guide image according to a subject's physicalcharacteristics. More specifically, first, the guide image generator 43generates a guide image according to a subject's physicalcharacteristics recognized by a capture result captured by a camera 1.Subsequently, the display controller 44 controls a selected display unitto display a guide image at a position corresponding to the subject'sphysical characteristics. Hereinafter, operations of a display controlsystem according to the present modification will be described withreference to FIG. 8.

FIG. 8 is an explanatory diagram for explaining operations of a displaycontrol system according to Modification 1. As illustrated in FIG. 8, asubject 5A of tall height and a subject 5B of short height are walkingalong a corridor in the X direction.

Herein, in the case of looking at information displayed on a floor,generally, since a person of tall height has a higher point of view, alarger display is easier to see, whereas the opposite is true for aperson of short height. For this reason, the guide image generator 43may generate a large guide image in proportion to the physicalcharacteristic of height for a subject 5. Specifically, as illustratedin FIG. 8, since the subject 5A is of tall height, the guide imagegenerator 43 generates a goal selection image 9-41 of large size, whichis displayed on the display surface 3A by the display device 2A. On theother hand, since the subject 5B is of short height, the guide imagegenerator 43 generates a goal guide image 9-42 of small size, which isdisplayed on the display surface 3B by the display device 2B.

Furthermore, in the case of looking at information displayed on a floor,generally, since a person of tall height has a higher point of view,information displayed at a position distanced from the place where theperson is standing is easier to see, whereas the opposite is true for aperson of short height. For this reason, the display controller 44 mayalso control a selected display unit to display a guide image at aposition distanced in proportion to the physical characteristic ofheight for a subject 5. Specifically, as illustrated in FIG. 8, sincethe subject 5A is of tall height, the display controller 44 controls thedisplay device 2A to display the goal selection image 9-41 at a positiondistanced from the subject 5A on the display surface 3A. On the otherhand, since the subject 5B is of short height, the display controller 44controls the display device 2B to display the goal guide image 9-42 at aposition close to the subject 5B on the display surface 3B.

Moreover, in the case of looking at information displayed on a wall,generally, since a person of tall height has a higher point of view, adisplay at a high position is easier to see, whereas the opposite istrue for a person of short height. For this reason, the displaycontroller 44 may also control a selected display unit to display aguide image at a higher position in proportion to the physicalcharacteristic of height for a subject 5. Specifically, as illustratedin FIG. 8, the display controller 44 controls the display device 2C todisplay a goal guide image 9-43 at a low position inside the displaysurface 3C, to match the position of the point of view of the subject 5Bwith a short height.

In this way, a display control system according to the presentmodification is able to display an easily visible guide image at aneasily visible position according to a subject's physicalcharacteristics.

(Supplemental Remarks)

The display controller 44 may also control a display device 2 to displaya guide image at a position distanced in proportion to a subject'swalking speed. Otherwise, the guide image generator 43 and the displaycontroller 44 may also operate according to externally distinguishablefactors, such as a subject's sex, race, or age. For example, a displaydevice 2 may provide a warning display in the case where the predictor42 predicts that a subject will mistakenly enter a restroom for theopposite sex.

2-1-4. Modification 2

Another modification of the first embodiment will be described. In thecase where multiple persons are in the same place, a display controlsystem according to the present modification provides a display suchthat a guide image for each person is difficult for the other persons tosee. More specifically, in the case where another person is present neara subject, the display controller 44 controls a selected display unit todisplay a guide image for the subject distinguishably from another guideimage displayed for the other person. Hereinafter, operations of adisplay control system according to the present modification will bedescribed with reference to FIG. 9.

FIG. 9 is an explanatory diagram for explaining operations of a displaycontrol system according to Modification 2. As illustrated in FIG. 9,subjects 5C and 5D are walking along a corridor in the X direction,while a subject 5E is walking along a corridor in the Y direction.First, since there is no other person in the vicinity of the subject 5C,the display controller 44 displays a goal selection image 9-51 on thedisplay surface 3A without conducting special processing. On the otherhand, since the subjects 5D and 5E are walking to the same point, thedisplay controller 44 distinguishably displays a goal guide image 9-52for the subject 5D and a goal guide image 9-53 for the subject 5E on thedisplay surface 3B.

More specifically, as illustrated in FIG. 9, the display controller 44displays the goal guide image 9-52 for the subject 5D at the feet of thesubject 5D, and displays the goal guide image 9-53 for the subject 5E atthe feet of the subject 5E. Also, as illustrated in FIG. 9, the guideimage generator 43 may also generate the goal guide image 9-52 and thegoal guide image 9-53 at small sizes so as to not enter into eachother's field of view. Also, the display controller 44 may control thedisplay device 2C to not display any guide image on the display surface3C on the wall where there is a possibility of being seen by multiplepersons.

Otherwise, in the case where multiple subjects 5 are walking in a row,for example, the display controller 44 may also display a guide imagefor a subject 5 walking in the back behind a subject 5 walking in front.Also, the display controller 44 may display a guide image for a subject5 walking in the back on the back of a subject 5 walking in front.

In this way, in the case where another person is present near a subject,a display control system according to the present modification displaysa guide image for the subject distinguishably from another guide imagedisplayed for the other person. Consequently, a subject is able toreceive the display of a guide image without being confused with a guideimage for another person, even in the case where multiple people are inthe same place.

2-1-5. Modification 3

Another modification of the first embodiment will be described. In adisplay control system according to the present modification, eachcamera 1 includes a respective configuration of the server 4 in thefirst embodiment, and conducts bidirectional communication and control.In the present modification, a camera 1 placed at a position closest toa subject is taken to operate as the server 4 in the first embodimentfor that subject.

More specifically, a camera 1 compares the distances from other cameras1, and conducts action history information acquisition, prediction,guide image generation, and guide image display for the subject at theclosest distance. At this point, in the case where the subject moves andanother camera 1 becomes closest to the subject, the camera 1 that hadbeen operating as the server 4 up to that point transmits acquiredaction history information for the subject to the other camera 1.Subsequently, the other camera 1 uses received action historyinformation to take over operation as the server 4 for the subject. Notethat this assumes that each camera 1 stores position information aboutcameras 1 and display devices 2 placed nearby at least, and determineswhich camera 1 will take over on the basis of the position information.

Hereinafter, operations of a display control system according to thepresent modification in the applied example illustrated in FIG. 4 willbe described with reference to FIG. 10.

FIG. 10 is a flowchart illustrating operations of a display controlsystem according to Modification 3. First, in steps S204A and S204B, thecamera 1A and the camera 1B capture the subject 5 walking in the Xdirection.

Next, in step S208, the camera 1B transmits a captured image capturingthe subject 5 to the camera 1A placed at a position closer to thesubject 5.

Subsequently, in step S212, the action history information acquirer 41included in the camera 1A acquires action history information from thecaptured image captured by the camera 1A and the captured image receivedfrom the camera 1B.

After that, the display control system operates from steps S216 to S236Aand S236B similarly to steps S116 to S136A and S136B described withreference to FIG. 3 above.

Subsequently, in step S240, the camera 1B transmits a captured imagecapturing a subject 5 to the camera 1A.

Next, in step S244, the action history information acquirer 41 includedin the camera 1A acquires action history information from a capturedimage captured by the camera 1A and the captured image received from thecamera 1B.

Assume that, since the subject 5 is continuing to walk, the camera 1closest to the subject 5 at this point changes from the camera 1A to thecamera 1B. In this case, functionality as the server 4 is passed overfrom the camera 1A to the camera 1B as discussed above. For this reason,in step S246, the camera 1A transmits acquired action historyinformation to the camera 1B.

After that, the display control system operates from steps S248 to S264Band S264C similarly to steps S148 to S164A and S164B described withreference to FIG. 3 above.

In this way, a display control system according to the presentmodification is able to distribute operation as a server 4 among thecameras 1 closest to each subject, without installing a server 4.

The above thus describes modifications in accordance with the firstembodiment.

2-2. Second Embodiment

Next, a display control system according to the second embodiment willbe described. The present embodiment is a configuration that displays aguide image according to an action pattern learned by the learning unit45. Since the configuration of a display control system according to thepresent embodiment is as described in the first embodiment, detaileddescription will be omitted herein. Hereinafter, operations of a displaycontrol system according to the present embodiment will be describedwith reference to FIGS. 11 to 12.

2-2-1. Operational Process

FIG. 11 is a flowchart illustrating operations of a display controlsystem according to the second embodiment. FIG. 12 is an explanatorydiagram illustrating an applied example of a display control systemaccording to the second embodiment. Hereinafter, operations of thedisplay control system in the applied example illustrated in FIG. 12will be specifically described, following the flowchart illustrated inFIG. 11.

As illustrated in FIG. 12, cameras 1A and 1B, display devices 2A, 2B,and 2C, and a cabinet 11 storing equipment are placed in a conferenceroom. First, as illustrated in FIG. 11, in steps S304A and 304B, thecamera 1A and the camera 1B capture a subject 5F who is searching for acable with which to connect a laptop personal computer (PC) 10 to thedisplay device 2C and display an image on a display surface 3C.

Subsequently, in step S308, the camera 1A and the camera 1B transmitcaptured images to the server 4.

Next, in step S312, the action history information acquirer 41 acquiresaction history information from the captured images received from thecamera 1A and the camera 1B. More specifically, the action historyinformation acquirer 41 acquires, as action history information, thesubject 5F holding the laptop PC 10, having a worried look, behaving asthough searching for something, and finding a cable.

Subsequently, in step S316, the learning unit 45 learns an actionpattern of the subject 5F from the action history information output bythe action history information acquirer 41. More specifically, thelearning unit 45 learns that the subject 5F is searching for a cable inthe case where he or she is holding the laptop PC 10 with a worriedlook.

After that, in steps S320A and S320B, the camera 1A and the camera 1Bcapture the subject 5F putting away a used cable in the cabinet 11.

Subsequently, in step S324, the camera 1A and the camera 1B transmitcaptured images to the server 4.

Then, in step S328, the server 4 remembers that the cable is stored inthe cabinet 11, or in other words, that the cable is positioned in thecabinet 11.

On another day, in steps S332A and S332B, the camera 1A and the camera1B again capturing subject 5F holding a laptop PC 10 with a worried lookand searching for a cable.

Subsequently, in step S336, the camera 1A and the camera 1B transmitcaptured images to the server 4.

Next, in step S340, the action history information acquirer 41 acquiresaction history information from the captured images received from thecamera 1A and the camera 1B. More specifically, the action historyinformation acquirer 41 acquires, as action history information, thesubject 5F holding the laptop PC 10 and having a worried look.

Subsequently, in step S344, the predictor 42 predicts the actions of thesubject 5F on the basis of an action pattern learned by the learningunit 45. More specifically, the predictor 42 references the actionpattern for a subject 5F holding a laptop PC 10 and having a worriedlook, and predicts that the subject 5F is currently searching for acable.

Next, in step S348, the display controller 44 selects the display device2A, which is able to display an image at a position easily visible tothe subject 5F. Subsequently, in step S352, the guide image generator 43generates a guide image that includes a display suggesting actions to asubject according to a prediction result based on an action pattern.More specifically, according to the prediction result that the subject5F is currently searching for a cable, the guide image generator 43generates a guide image indicating the cable position to the subject 5Fand suggesting cable acquisition.

Next, in step S356, the display controller 44 transmits the guide imageto the display device 2A, and in step S360 the display device 2Adisplays a guide image 9-61 suggesting cable acquisition to the displaysurface 3A.

(Supplemental Remarks)

The display control system may also display a guide image based on anaction pattern learned for another person to a subject. For example, inthe above example, in the case where another subject 5 is holding alaptop PC 10 with a worried look in a conference room, the displaycontrol system may likewise take that other subject to be searching fora cable similarly to the subject 5F, and display a guide imagesuggesting cable acquisition. Otherwise, in the case where multiplepeople perform the same action in the same place, the display controlsystem may display a guide image suggesting the same action as an actionperformed by multiple people, even if the subject has never been to thatplace before.

In this way, a display control system according to the presentembodiment is able to display a guide image suggesting an action to asubject, on the basis of a learned action pattern. For this reason, asubject is able to receive a suggestion for an action to perform,without performing some kind of conscious action such as inputting agoal selection or object of search into the display control system.

The above thus describes an operational process of a display controlsystem according to the second embodiment.

2-2-2. Applied Example 1

Next, another applied example of the second embodiment will bedescribed. Hereinafter, operations of a display control system accordingto an applied example will be described with reference to FIG. 13.

FIG. 13 is an explanatory diagram illustrating an applied example of adisplay control system according to the second embodiment. Asillustrated in FIG. 13, although a subject 5 had poured hot water overinstant noodles 12 in a kitchen several minutes earlier, currently he orshe is reading in a separate room from the kitchen. The display device2B is displaying a guide image 9-71 indicating the remaining time untilthe instant noodles 12 are ready on a display surface 3B, but since thesubject 5 is reading, the subject 5 would not notice even if a guideimage indicating that the instant noodles 12 are ready were displayed onthe display surface 3B.

At this point, assume that the learning unit 45 has already learned anaction pattern of the subject 5 pouring hot water over instant noodles12 and eating in the case where the remaining time reaches zero. On thebasis of the action pattern learned by the learning unit 45, thepredictor 42 predicts that the subject 5 will eat the instant noodles 12in the case where the remaining time reaches zero. In this case, theguide image generator 43 generates a guide image indicating that theremaining time has reached zero as a guide image including a displaysuggesting an action to the subject 5. Then, when the remaining timereaches zero, the display device 2A displays the generated guide image9-72 on a display surface 3A perceivable by the subject 5 who isreading.

2-2-3. Applied Example 2

In addition, another applied example of the second embodiment will bedescribed. Hereinafter, operations of a display control system accordingto an applied example will be described with reference to FIG. 14.

FIG. 14 is an explanatory diagram illustrating an applied example of adisplay control system according to the second embodiment. Asillustrated in FIG. 14, a subject 5G and a subject 5H are dining at thesame table in a restaurant, and multiple knives, forks, and spoons areplaced on the table as cutlery. Generally, although cutlery is usedstarting from those placed on the left and right ends, sometimes thereare cases in which only the one on the right end is used, or cases inwhich one placed inward is used. Consequently, in some cases a subjectmay not know which cutlery to use unless he or she asks an employee.

At this point, assume that the learning unit 45 has previously learnedaction patterns of dishes brought out in a restaurant and the cutlerycorresponding to such dishes. Thus, when dishes are served to thesubject 5G and the subject 5H, the guide image generator 43 generates aguide image indicating the cutlery corresponding to each dish as a guideimage including a display suggesting an action to the subjects 5G and5H. The display devices 2 then distinguishably display a guide image forthe subject 5G and a guide image for the subject 5H. For example, in theexample illustrated in FIG. 14, the display devices 2A and 2B displayguide images 9-81 and 9-82 (spotlights) indicating the knife and forkplaced on either side of the subject 5G on respective display surfaces3A and 3B. Also, the display device 2C displays a guide image 9-83(spotlight) indicating the spoon placed inward to the subject 5H on adisplay surface 3C.

2-2-4. Other Applied Examples

Otherwise, a display control system according to the present embodimentmay also display a guide image suggesting an eating order to a subject.For example, at a buffet-style restaurant, the display control systemmay also display a guide image suggesting a freshly-cooked dish or thelocation of a recommended dish. Otherwise, the display control systemmay also display a guide image to a subject who takes multiplemedicines, suggesting the order or interval at which to take themedicines.

Also, a display control system according to the present embodiment mayalso provide a display of a guide image according to a subject'spossessions. For example, in the case where a subject inside a hospitalis walking while holding an internal medicine patient card, thepredictor 42 predicts that the subject will go to an internal medicineexamination room, and the display controller 44 may control a displaydevice 2 to display a goal guide image with an internal medicineexamination room set as the goal.

Also, a display control system according to the present embodiment mayalso be applied to a surveillance system. For example, in the case ofcapturing a person behaving suspiciously near a private home, thatsuspicious behavior may fit into a previously learned action pattern fora suspicious person, and thus the predictor 42 may determine that personto be a suspicious person and emit a warning sound. Otherwise, thesuspicious behavior may not fit into any previously learned actionpattern, and thus the predictor 42 may treat that person's actions asunpredictable, and emit a warning sound. Obviously, a display controlsystem according to the present embodiment may not only emit a warningsound, but also contact a security company, or in some cases, report tothe police.

3. CONCLUSION

As described above, a display control system according to an embodimentof the present disclosure is able to predict a subject's actions, andprovide a guide display according to the prediction result. In thiscase, the display control system is capable of providing a guide displayat an easily visible position and range, according to the subject'sfacing, movement speed, and physical characteristics. Also, even in thecase where multiple persons are concentrated in the same place, adisplay control system is able to provide a guide display to a subjectwithout causing confusion with a guide display for another person.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

For example, although in the foregoing embodiments a display device 2 isrealized by an installed projector or the like, the present technologyis not limited to such an example. For example, a display device 2 mayalso be realized by a head-mounted display (HMD). In this case, thedisplay controller 44 displays a guide image such as a goal selectionimage or a goal guide image according to information such as theposition and facing of a subject wearing an HMD, and the height whenworn.

Also, it is possible to create a computer program for causing hardwaresuch as the CPU, ROM, and RAM built into an information processingdevice to exhibit the same functionality as the respective components ofa camera 1, display device 2, and server 4 discussed earlier. Also, arecording medium having such a computer program recorded thereon is alsoprovided.

Additionally, the present technology may also be configured as below.

(1) A display control system including:

a plurality of display units;

an imaging unit configured to capture a subject;

a predictor configured to predict an action of the subject according toa captured image captured by the imaging unit;

a guide image generator configured to generate a guide image that guidesthe subject according to a prediction result from the predictor; and

a display controller configured to, on the basis of the predictionresult from the predictor, select a display unit capable of displayingan image at a position corresponding to the subject from the pluralityof display units, and to control the selected display unit to displaythe guide image at the position corresponding to the subject.

(2) The display control system according to (1), further including:

an action history information acquirer configured to acquire actionhistory information of the subject on the basis of the captured image,

wherein the predictor predicts the action of the subject on the basis ofthe action history information acquired by the action historyinformation acquirer.

(3) The display control system according to (2), wherein

the action history information acquirer recognizes a reaction of thesubject to the guide image displayed by the selected display unit on thebasis of the captured image, and acquires the action history informationon the basis of the recognized reaction.

(4) The display control system according to any one of (1) to (3),wherein

the guide image generator generates the guide image according a physicalcharacteristic of the subject.

(5) The display control system according to any one of (1) to (4),wherein

the display controller controls the selected display unit to display theguide image at a position according to a physical characteristic of thesubject.

(6) The display control system according to (4), wherein

the guide image generator generates a large guide image in proportion toa physical characteristic of height of the subject.

(7) The display control system according to (5), wherein

the display controller controls the selected display unit to display theguide image at a position distanced in proportion to a physicalcharacteristic of height of the subject.

(8) The display control system according to any one of (1) to (7),wherein

the display controller controls the selected display unit to display theguide image at a position distanced in proportion to a movement speed ofthe subject.

(9) The display control system according to any one of (1) to (8),wherein

the display controller selects, from the plurality of display units, adisplay unit capable of displaying an image near a position of thesubject.

(10) The display control system according to any one of (1) to (9),wherein

the display controller selects, from the plurality of display units, adisplay unit capable of displaying an image in a direction in which thesubject faces.

(11) The display control system according to any one of (1) to (10),wherein

the display controller, in a case in which another person is presentnear the subject, controls the selected display unit to display theguide image for the subject distinguishably from another guide imagedisplayed for the other person.

(12) The display control system according to any one of (1) to (11),wherein

the guide image includes a guide display to a goal of the subjectindicated by the prediction result from the predictor.

(13) The display control system according to (2) or (3), furtherincluding:

a learning unit configured to learn an action pattern of the subjectfrom the action history information,

wherein the predictor predicts the action of the subject on the basis ofthe action pattern learned by the learning unit.

(14) The display control system according to (13), wherein

the guide image includes a display suggesting an action to the subjectaccording to a prediction result based on the action pattern from thepredictor.

(15) A non-transitory computer-readable recording medium having aprogram recorded thereon, the program causing a computer to execute:

capturing a subject;

predicting an action of the subject according to a captured image;

selecting, from a plurality of display units on the basis of aprediction result, a display unit capable of displaying an image at aposition corresponding to the subject;

generating a guide image that guides the subject according to theprediction result; and

controlling the selected display unit to display the guide image at theposition corresponding to the subject.

What is claimed is:
 1. A display control system comprising: a processingdevice and a memory including instructions which, when executed by theprocessing device, control: displaying, in front of a same subject, aplurality of guide images simultaneously and arranged together with eachother, in which the plurality of guide images indicates a plurality ofdifferent first goals displayed extending from the front of the samesubject to guide the same subject to the respective first goals;acquiring, as an action history information, a recognized reaction ofthe same subject selecting one displayed guide image of the plurality ofthe simultaneously displayed guide images, based on a determinationwhether a captured image indicates a predetermined action by the samesubject with respect to the one displayed guide image; and displaying,in front of the same subject, at least one updated guide imageindicating at least one second goal displayed extending from the frontof the same subject to guide the same subject to the at least one secondgoal, in which the at least one second goal is different from each goalof the one displayed guide image, so as to provide an interactive guidearrangement which enables a given goal to be changed based on therecognized reaction of the subject, in which a number of goals displayedas the at least one second goal is less than a number of goals displayedas the plurality of different first goals.
 2. The display control systemaccording to claim 1, wherein the instructions, when executed by theprocessing device, control capturing an image of the same subject. 3.The display control system according to claim 1, wherein theinstructions, when executed by the processing device, control display ofa first guide image at a position according to a physical characteristicof the same subject.
 4. The display control system according to claim 1,wherein the instructions, when executed by the processing device,control display of a first guide image configured according to aphysical characteristic of the same subject.
 5. The display controlsystem according to claim 4, wherein the physical characteristic of thesubject is a height of the same subject, and the instructions, whenexecuted by the processing device, control displaying a large guideimage in proportion to the height of the same subject.
 6. The displaycontrol system according to claim 4, wherein the physical characteristicof the same subject is a height of the same subject, and theinstructions, when executed by the processing device, control display ofthe first guide image at a position distanced in proportion to theheight of the same subject.
 7. The display control system according toclaim 1, wherein the instructions, when executed by the processingdevice, control display of a first guide image at a position distancedin proportion to a movement speed of the same subject.
 8. The displaycontrol system according to claim 1, wherein the instructions, whenexecuted by the processing device, in a case in which another person ispresent near the same subject, control display of a first guide imagefor the subject distinguishably from another guide image displayed forthe other person.
 9. The display control system according to claim 1,wherein the instructions, when executed by the processing device,control display of a first guide image including a guide display to agoal of the same subject indicated by a prediction result.
 10. Thedisplay control system according to claim 1, wherein the instructions,when executed by the processing device, control learning an actionpattern of the same subject from the action history information andpredicting a reaction of the same subject based on the action pattern.11. The display control system according to claim 10, wherein theinstructions, when executed by the processing device, control display ofa first guide image including a display suggesting an action to the samesubject according to a prediction reaction based on the action pattern.12. The display control system according to claim 1, wherein therecognized reaction of the same subject is based on walking of the samesubject.
 13. The display control system according to claim 1, whereinthe recognized reaction of the same subject is based on stopping of thesame subject.
 14. The display control system according to claim 1,wherein the recognized reaction of the same subject is based on a handgesture of the same subject.
 15. The display control system according toclaim 1, wherein the recognized reaction of the same subject is based ona path selection of the same subject.
 16. The display control systemaccording to claim 1, wherein the number of goals displayed as theplurality of first goals is two and the number of goals displayed as theat least one second goal is one.
 17. The display control systemaccording to claim 1, wherein a number of goals displayed by theselected one displayed guide image is at least two.
 18. A displaycontrol method comprising: controlling displaying, in front of a samesubject, a plurality of guide images simultaneously and arrangedtogether with each other, in which the plurality of guide imagesindicates a plurality of different first goals displayed extending fromthe front of the same subject to guide the subject to the respectivefirst goals; controlling acquiring, as an action history information, arecognized reaction of the same subject selecting one displayed guideimage of the plurality of the simultaneously displayed guide images,based on determination whether a captured image indicates apredetermined action by the same subject with respect to the onedisplayed guide image; and controlling displaying, in front of the samesubject, at least one updated guide image indicating at least one secondgoal displayed extending from the front of the same subject to guide thesame subject to the at least one second goal, in which the at least onesecond goal is different from each of the one displayed guide image, soas to provide an interactive guide arrangement which enables a givengoal to be changed based on the recognized reaction of the subject, inwhich a number of goals displayed as the at least one second goal isless than a number of goals displayed as the plurality of differentfirst goals.
 19. A non-transitory computer-readable recording mediumconfigured to store a program, the program causing a computer toexecute: controlling displaying, in front of a same subject, a pluralityof guide images simultaneously and arranged together with each other, inwhich the plurality of guide images indicates a plurality of differentfirst goals displayed extending from the front of the same subject toguide the same subject to the respective first goals; acquiring, as anaction history information, a recognized reaction of the same subjectselecting one displayed guide image of the plurality of thesimultaneously displayed guide images based on a determination whether acaptured image indicates a predetermined action by the same subject withrespect to the one displayed guide image; and controlling displaying, infront of the same subject, at least one updated guide image indicatingat least one second goal displayed extending from the front of the samesubject to guide the same subject to the at least one second goal, inwhich the at least one second goal is different from each goal of theone displayed guide image, so as to provide an interactive guidearrangement which enables a given goal to be changed based on therecognized reaction of the subject, in which a number of goals displayedas the at least one second goal is less than a number of goals displayedas the plurality of different first goals.